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Abstract — When the Poincare map associated with a periodic 
orbit of a hybrid dynamical system has constant-rank iter- 
ates, we demonstrate the existence of a constant-dimensional 
invariant subsystem near the orbit which attracts all nearby 
trajectories in finite time. This result shows that the long- 
term behavior of a hybrid model with a large number of 
degrees-of-freedom may be governed by a low-dimensional 
smooth dynamical system. The appearance of such simplified 
models enables the translation of analytical tools from smooth 
systems — such as Floquet theory — to the hybrid setting and 
provides a bridge between the efforts of biologists and engineers 
studying legged locomotion. 

I. Introduction 

Dynamic multi-legged locomotion presents a daunting 
control task. A large number of degrees-of-freedom (DOF) 
must be rapidly and precisely coordinated in the face of 
state and environmental uncertainty. The ability of indi- 
vidual limbs to exert forces on the body varies intermit- 
tently with ground contact, body posture, and the efforts of 
other appendages. Finally, the motion itself affects sensor 
measurements, complicating pose estimation. In spite of 
these difficulties, animals at all levels of complexity have 
mastered the art of rapid legged locomotion over complex 
terrain at speeds far exceeding those of comparable robotic 
platforms [1], [2], [3], [4]. 

Numerous architectures have been proposed to explain 
how animals control their limbs. For steady-state locomotion, 
most posit a principle of coordination, synergy, symmetry or 
synchronization, and there is a surfeit of neurophysiological 
data to support these hypotheses [5], [6], [7], [8]. In effect, 
the large number of DOF available to an animal are collapsed 
during regular motion to a low-dimensional dynamical at- 
tractor that may be captured by a template model embedded 
within a higher-dimensional model anchored to the animal's 
morphology [9], [10]. In this view, only a few parameters like 
frequency and coupling strength are required to describe the 
dynamics of any particular periodic gait over a broad range 
of animal morphologies, offering a tantalizing target for ex- 
perimental biologists. Were the dynamics of legged animals 
smooth as a function of position and momentum, Floquet 
theory [11] provides a canonical form for the structure of the 
stability basin of a limit cycle [12], [13]. In such a canonical 
form, the template may appear as an invariant attractor of 
the linearized dynamics and be amenable to quantitative 
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Fig. 1. Illustration of the main result in a two-domain system: Whenever 
iterates of the Poincare map P associated with a periodic orbit 7 of a hybrid 
dynamical system are constant-rank, there is a constant-dimensional smooth 
submanifold Mi in each domain Dj which is invariant under the flow of 
the vector field Fj and which attracts all trajectories starting in an open set 
Wj C Dj containing 7 in finite time. 



measurement [14], [15]. A substantial motivation for the 
present work has been to provide a theoretical framework for 
applying this empirical approach to study legged locomotion. 
The dynamics of legged locomotion are rarely smooth due 
to intermittent contact of limbs with the substrate, so we 
have generalized this approach to be aplicable to a class of 
non-smooth systems called hybrid dynamical systems. 
We relegate a formal definition of the class of hybrid 



systems under consideration to Section III Informally, hybrid 
dynamical systems are comprised of differential equations 
written over disparate domains together with rules for switch- 
ing between the domains. Of particular interest to us are 
periodic orbits of such systems. From a modeling viewpoint, 
a stable hybrid periodic orbit provides a natural abstraction 
for the dynamics of steady-state legged locomotion. This 
approach has been widely adopted, generating a variety of 
models of bipedal [16], [17], [18] and multi-legged [19], [20] 
locomotion as well as some general control-theoretic tech- 
niques for composition [21], coordination [22], and stabiliza- 
tion [23], [24], [25] of such models. In certain cases, it has 
been possible to formally embed a low-dimensional abstrac- 
tion in a higher-dimensional physically-realistic model [26], 
[27]. 

This paper provides a conceptual link between formal 
analysis of hybrid periodic orbits and the dramatic dimension 



reduction observed empirically in successful legged loco- 
motors. Under the condition that iterates of the Poincare 
map associated with a periodic orbit are constant rank, 
we demonstrate the existence of a constant-dimensional 
invariant subsystem which attracts all nearby trajectories in 
finite time. Analogous results for smooth dynamical systems 
typically impose stringent assumptions on the dynamics such 
as exact symmetries (cf. §8.9 in [28]) or timescale separation 
(cf. Chapter 4 in [13]). In contrast, the results of this paper 
imply that hybrid dynamical systems may exhibit dimension 
reduction near periodic orbits solely due to the interaction 
of the switching dynamics with the smooth flow. 

Organization 

The hybrid systems we consider are constructed using 
switching maps defined between boundaries of smooth dy- 
namical systems. The behavior of such systems can be 
studied by alternately applying flows and maps. Thus, we 
begin in Section [n] by developing several results which 
provide canonical forms for the behavior of flows and maps 
near periodic orbits and fixed points, respectively. Then, 



we define hybrid systems in Section III and use these 



results to characterize the dynamics near their periodic orbits. 
Examples are presented in Section [TV] and implications of the 
results for the design and analysis of legged locomotors are 
explored in Section [V] 

II. Smooth Dynamical Systems 

This section contains three technical results used in the 
proof of the Theorem of Section [III] The first two results 
concern smooth dynamical systemfFJand may be found in 
textbooks, hence we state them without proof. The third 
establishes, under a non-degeneracy condition, a canonical 
form for the invariant set of a smooth map near a fixed 
point. A reader interested in the main result of this paper may 



proceed to Section III and refer to this section as needed. 



A. Differential Geometry 

We assume familiarity with the tools and terminology of 
differential geometry. If any of the concepts we discuss are 
unfamiliar, we refer the reader to [28], [29] for more details. 

A smooth n-dimensional manifold M with boundary dM 
is an n-dimensional topological manifold covered by a 
collection of smooth coordinate charts {(U a , ip a )} a where 
U a C M is open and ip a : U a — >• H n is a homeomorphism 
where H n := {(t/i, . . . ,y n ) £ R" : Vn > 0} is the upper 
half-space. The charts are smooth in the sense that ^o^ 1 
is a diffeomorphism over (f/3(U a D Up) for all pairs a,/3. 
The boundary dM C M contains those points which are 
mapped to the plane {(yi, . . . , y n ) £ K" : Vn = 0} in some 
chart. We say S C M is a smooth embedded k-dimensional 
submanifold if near every x £ S there is a smooth coordinate 
chart (U x ,ip x ) so that 



<p x (SnU x )c{yeW:y k+1 



Vn = 0} . 



'For notational convenience, we work with objects which possess con- 
tinuous derivatives of all orders. However, the results in this paper are valid 
if we only assume continuous differentiability. 



These charts yield slice coordinates for the submanifold, 
and the integer n ~ k is the codimension of S. It is a 
straightforward consequence that dM is a smooth embedded 
submanifold without boundary and has codimension 1. We 
denote the interior of M by Int(M) := M \ dM. 

Each x £ M has an associated tangent space T X M, and 
the disjoint union of the tangent spaces at each point is the 
tangent bundle TM := YlxeM T X M; note that any element 
in TM may be regarded as a pair (x, v) where x £ M 
and v £ T X M. We let 7(M) denote the space of smooth 
vector fields on M, i.e. smooth maps G : M —> TM for 
which G(x) = (x,v) for some v £ T X M and all x £ M, It 
is a fundamental result that any G 6 1(M) determines an 
ordinary differential equation on the manifold which may be 
solved globally to obtain a maximal flow </> : — > M where 
J C R x M is the maximal flow domain (cf. Theorem 17.8 
in [29]). This flow has several important properties which 
we will use repeatedly; let IP := {t £ K : (t,x) £ 5"} and 
SFj := {x £ M : (t,x) £ 5"}. First, for any initial condition 
x £ M, 4>(-,x) : SP — > M is the maximal integral curve of G 
passing through x, i.e. x) = G(4>(t, x)) for all t £ 1 X ; 

we will alternately refer to integral curves as trajectories. 
Second, for any smooth embedded submanifold S C M and 
t £ K for which {(}xSc 7, {(f>(t, x) : x £ S] C M is an 
embedded submanifold that is diffeomorphic to S. 

If / : M — > N is a smooth map between smooth 
manifolds, then at each x £ M there is an associated 
linear map f*(x) : T X M — > Tf/ X \N called the pushforward. 
Globally, the pushforward is a smooth map /* : TM —> TN. 
In coordinates, it is the familiar Jacobian matrix. The rank 
of a smooth map / : M — > N at a point xGMis defined 
ran^ / := rank/*(a:). If rank^ / = r for all x £ M, 
we simply write rank/ = r. If rank/ = dim M and / 
is a homeomorphism onto its image, then / is a smooth 
embedding, and the image of / is a smooth embedded 
submanifold. In this case, any smooth vector field G £ T(M) 
may be pushed forward to a unique smooth vector field 
/,Ge 7(f(M)). A vector field G £ 7(M) is transverse 
to a k -dimensional embedded submanifold S at x £ S if, in 
slice coordinates (U x , ip x ) near x, the (k+j) th coordinate of 
<p*G is non-zero for some j between 1 and n — k; otherwise 
G is tangent. If S C dM, G is inward-pointing if the n th 
coordinate of ip^G is positive and outward-pointing if it is 
negative. 

With these preliminaries established, we are in a position 
to define one of the main dynamical objects of interest in 
this paper. 

Definition 1. A smooth dynamical system is a pair (M, G): 

M is a smooth manifold with boundary dM; 
G is a smooth vector field on M, i.e. G £ 7{M). 

B. Flows Between Surfaces 

We review the fact that the flow near a trajectory pass- 
ing transversally between two surfaces has a simple form 
(cf. Chapter 11.2 in [30]). In particular, nearby trajectories 
can be obtained from an embedding of a product manifold. 



This will be the prototype for the dynamics near a periodic 
orbit in one domain of a hybrid system. 

Lemma 1. Let (M, G) be a smooth dynamical system and 
4> : J — > M its maximal flow. Suppose T, S C M are smooth 
embedded submanifolds, S has codimension 1, <p(a, £) £ S 
for some a > and £ £ T where G is transverse to T at £ 
and S at (f>(a, £). TTzen we /lave the following consequences: 

(i) f/zere is a neighborhood U C M containing £ ant/ a 
smooth map rj : U -> M io f/za? ?y(£) = a one/ /or all 
x £ U, r)(x) > and (j)(r}(x),x) £ S; r\ is called the 
time-to-impact map; 

(ii) with V :—U flT, the map ip : [0, 1] x V ->• M with 

ip{a,v) := cj)(r](v)<T,v) 

is a smooth embedding into M whose image contains 
the trajectory 7 = {<p(t, £) : < t < a}. 

Remark 1. This lemma is applicable when T, S C dM, 
which will be relevant in the study of hybrid systems. 

C. Gluing Flows 

In this section, we provide a method for gluing two smooth 
dynamical systems together along their boundaries to obtain 
a new smooth system; this construction uses basic results 
from differential topology (cf. Theorem 8.2.1 in [31]). We 
will use this construction in Section [HI] to attach distinct 
hybrid domains to one another. 

Lemma 2. Suppose (Mi, Gi), (M2, G2) are smooth n- 
dimensional dynamical systems, ip : dMi —¥ dMi is a 
diffeomorphism, G\ is outward-pointing along dM\ and G 2 
is inward-pointing along dM 2 . Then the topological quotient 

M : = 0M^dM 2 can ^ e ma d e lnl ° a smooth manifold for 
which (i) the inclusions Mj ^ M are smooth embeddings 
and (ii) there is a smooth vector field G £ T(M) that 
restricts to Gj on Mj, j = 1,2. 

Remark 2. The smooth structure described in Lemma [2] is 
unique. Further, if G\ and Gi are any other smooth vector 
fields on M\ and Mi which satisfy the hypotheses of the 
Lemma, the corresponding quotient M is diffeomorphic to 
M (cf. Chaper 8 in [31 ]). 

D. Invariant Set of a Smooth Map Near a Fixed Point 

In studying hybrid dynamical systems, we encounter 
smooth maps / : M —> M which are not diffeomorphisms. 
Viewing iteration of / as a discrete dynamical system, we 
wish to study the behavior of these iterates near a fixed point 
/(£) = £■ Note that if / has constant rank equal to k £ N, 
then its image f(M) C M is an embedded fc-dimensional 
submanifold near £ by the Rank Theorem (cf. Theorem 7.13 
in [29]). With an eye toward dimension reduction, one might 
hope that the composition (/ o /) : M — > f(M) is also 
constant-rank, but this is not generally tru^] If it is true 
that iterates of / are eventually constant-rank near the fixed 

2 Consider the map / : M 2 — > M 2 defined by f(x,y) := (x 2 ,x). 



point £, then one can study the behavior of these iterates by 
restricting the domain to a lower-dimensional submanifold. 

Lemma 3. Let M be a smooth manifold, f : M M a 
smooth map with /(£) = £ for some £ £ M, suppose the 
rank of f is bounded above by n £ N, and suppose the 
composition of f with itself n times, f n , has constant rank 
equal to r £ N on a neighborhood of £. Then f n (M) is 
an r-dimensional embedded submanifold near £ and there 
are neighborhoods U, V C f n (M) containing £ for which f 
maps U diffeomorphically onto V. 

In the proof of Lemma [3] we make use of an elementary 
fact from linear algebra. The result is easily obtained by 
passing to the Jordan form. 

Proposition 1. If A £ R mxm and rank A < n, then 
vank(A 2n ) = va,nk(A n ). 

Proof, (of Lemma [?]) By the Rank Theorem (cf. Theorem 
7.13 in [29]), there is a neighborhood N c M of £ for which 
S := f n (N) is an r-dimensional embedded submanifold and 
by Proposition [T] we have 

rank(r| E )JO=rank(ro/") JK (0 

= rank /HO • 

Therefore (/ n |s)* : -> T 5 E is a bijection, so by the 
Inverse Function Theorem (cf. Theorem 7.10 in [29]), there 
is a neighborhood W C £ containing £ so that f n (W) C £ 
and f n \w '■ W — > f n {W) is a diffeomorphism. 

By continuity of /, there is a neighborhood L C N 
containing £ for which f(L) C N and f n (L) C W. The 
set U := f n (L) is a neighborhood of £ in S. Further, we 
have 

f(U)= /o/»(L) = /«o/(i)cS. 

The restriction f n \u ■ U — > f n (U) is a diffeomorphism since 
U C W, whence f\jj is a diffeomorphism onto its image, 
V:=f(U)cE. ' ' □ 

III. Hybrid Dynamical Systems 

We describe a class of hybrid systems useful for modeling 
legged locomotion, then restrict our attention to the behavior 
of such systems near periodic orbits. It was shown in [32] 
that the Poincare map of a hybrid system is generally not full 
rank. We explore the geometric consequences of this rank 
loss and demonstrate, under a non-degeneracy condition, the 
existence of a smooth invariant subsystem which attracts all 
nearby trajectories in finite time. 

A. Hybrid Differential Geometry 

For our purposes, it is expedient to define hybrid dynam- 
ical systems over disjoint unions of smooth manifolds. 

Definition 2. A smooth hybrid manifold is a finite disjoint 
union of connected smooth manifolds M — Ujgj Mj. 

Remark 3. 77ie dimensions of the constituent manifolds are 
not required to be equal. 



Differential geometric constructions which are confined 
to a single manifold have natural generalizations to such 
spaces, and we will prepend the modifier "hybrid" to make it 
clear when this generalization is being invoked. For instance, 
the hybrid tangent bundle TM is the disjoint union of 
the tangent bundles TMj, the hybrid boundary dM is the 
disjoint union of the boundaries dMj, and a hybrid open 
set U C M is obtained from a disjoint union of open sets 
Uj C Mj. Generalizing maps between manifolds requires 
more care, hence we provide explicit definitions. 

Assumption 1. To simplify the exposition, we henceforth as- 
sume all manifolds and maps between manifolds are smooth. 

Definition 3. A hybrid map 

/ ■ ii M j > n \ , 

jeJ leL 

between hybrid manifolds restricts to a map f\u '■ Mj — ► 
Ni, some £ G L, for each j G J. The hybrid map is called 
constant-rank injective, or surjective if each /|m< is as well. 
It is called an embedding if each fluj is an embedding and 
f is a homeomorphism onto its image. 

Definition 4. The hybrid pushforward /* : TM -> TN is 

the hybrid map defined piecewise as /*|tMj := (/|m,-)*- 

Definition 5. A hybrid vector field on a hybrid manifold 
M := Ujgj Mj is a hybrid map G : M TM for which 
G\ma is a vector field on Mj, i.e. G\m 6 € f(Mj). We let 
T(M) denote the space of hybrid vector fields on M. 

To state the main result of this paper, we need to embed 
manifolds into hybrid manifolds. This can be achieved by 
first partitioning the smooth manifold to obtain a hybrid 
manifold, then embedding this hybrid manifold via the 
previous definitions. 

Definition 6. A partition of an n-dimensional manifold 
M is a finite set {Mj}- eJ of embedded n-dimensional 
submanifolds Mj C M for which Uj e jMj — M and if 
j we have Int(Mj-) n Int(Mj) = 0. 

Definition 7. A hybrid embedding of a manifold M into a 
hybrid manifold N :— JJj e j Nj is determined by a partition 
{Mj}j e J of M and a hybrid embedding 

f II M i II N i 

jeJ jeJ 

for which fj : Mj -» Nj for each j G J. Any G € T(M) 
may be pushed forward to a unique /,G € T(/(M)). The 
image of f is a hybrid embedded submanifold. 

With these preliminaries established, we can define the 
class of hybrid systems considered in this paper. To the 
best of our knowledge, this definition of a hybrid dynamical 
system has not appeared before. However, in light of the 
constructions contained in this section, it may be seen as 
a mild generalization of a simple hybrid system (cf. §3.2 
in [33]). Further, in Section |III-C| we will see that this defi- 
nition supports powerful geometric analysis of the dynamics 



near a hybrid periodic orbit. Finally, this class of hybrid 
systems encompasses many closed-loop models of legged 
locomotion [16], [17], [18], [19], [20], [23], [24], [26], [27]. 
We contend that these facts justify the introduction of the 
novel definition. 

Definition 8. A hybrid dynamical system is specified by a 
triple H := (D, F, R) where: 

D = YljeJ is a hybrid manifold; 
F G f{D) is a hybrid vector field on D; 
R : S — > T is a hybrid map, S,T C dD are hybrid 
embedded submanifolds, and S has codimension 1. 
As in [33], we call R the reset map and S the guard. 

Note that if F is tangent to S at x € D, there is a 
possible ambiguity in determining a trajectory from x — one 
may either follow the flow of F on D or apply the reset map 
to obtain a new initial condition y = R(x). 

Assumption 2. To ensure that trajectories are uniquely 
defined, we assume that F is outward-pointing on S. 

Remark 4. As defined above, hybrid dynamical systems 
possess unique executions or trajectories from every initial 
condition. This fact can be demonstrated algorithmically. For 
any x € Dj, obtain the maximal integral curve of F\r> . 
This integral curve must either: a) continue for all time; b) 
exit Dj without intersecting dDj (in which case execution 
terminates); or c) intersect the boundary at y G dDj. If 
y € S, the map R is applied to obtain a new initial condition 
R{y) G T, and otherwise execution terminates. 

The following definition enables us to embed smooth 
dynamical systems into hybrid dynamical systems in such a 
way that trajectories of the smooth system are preserved in 
the hybrid system. We illustrate the use of this construction 
by giving a terse description of trajectories for this class 
of hybrid systems. In the subsequent sections, we use this 
construction to state the main results of this paper. 

Definition 9. A hybrid dynamical embedding of a dynamical 
system (M,G) into a hybrid dynamical system (D,F,R) is 
a hybrid embedding f : M — > D for which f*G = -F|/(m) 
and R\f(M)nS is a hybrid diffeomorphism from f(M) f] S 
onto f(M) n T. 

Remark 5. A trajectory of a hybrid dynamical system H 
may be obtained from a hybrid dynamical embedding of the 
system (j, tLV where JcM is a connected interval. 

Definition 10. A r-periodic orbit of a hybrid dynamical 
system is a hybrid dynamical embedding 7 of the dynamical 
system (S 1 , where S 1 is the unit circle. 

Remark 6. We alternately refer to 7 as a periodic trajectory 
and often write 7 in place of the image 7(5' 1 ). 

B. Hybrid Poincare map 

To state the main result of this paper, we must construct 
the Poincare map associated with a periodic orbit of a 
hybrid system. This has been developed before [24], [32]; 



the construction is more delicate than for smooth systems 
since trajectories of hybrid systems do not necessarily vary 
continuously with initial conditions. We directly demonstrate 
this continuous dependence in the construction of the map. 

Let H = (D,F, R) be a hybrid dynamical system and 
7 a periodic orbit of H with period r. Then 7 undergoes 
a finite number of transitions k G N, so we may index the 
corresponding sequence of domains as^]z?i, . . . , D k . Without 
loss of generality, assume the Dj's are distincj^J let jj :— 
7 n Tj be the entry point of 7 in Dj and let tj be the time 
spent by 7 in Dj. We wish to construct the Poincare map 
P associated with 7 over a neighborhood of jj in T. To 
do this, we must ensure that each initial condition in that 
neighborhood has a well-defined non-zero first-return time 
to T; the following assumption guarantees this. 

Assumption 3. To ensure the Poincare map is well-defined, 
we assume F is transverse to T and not outward-pointing. 

Now for j = l,...,k and referring to Fig. [2] for an 
illustration of these objects, let: 

4>j : ?j — > Dj be the maximal flow of F on Dj\ 

Tj C T n Dj be a neighborhood of jj over which 

Lemma [JJ may be applied between T and S on Dj\ 
tpj : [0, 1] x Tj — > Dj be the embedding from Lemma [TJ 
Sj := V>i(l, Tj) C S n £>j be the image of I) in 5 under 

the flow on ; 
Rj : Sj — >■ T denote the restriction i?j := R\s s ', 
p 3 :Tj-tT be defined by Pj(u) :— Rj(tpj(l, u)). 

The Poincare map over the section Tj is obtained formally 
by iterating the p's around the cycle: 



■ Pj-i 



op 1 op k o---o Pj . 



(1) 



The neighborhood £j C Tj of jj over which this map is 
well-defined is determined by pulling Tj backward around 
the cycle, 



P k 1 Pi 1 



(Tj), 



and similarly for any iterate of Pj. 

It is a standard result for smooth dynamical systems 
that Floquet multipliers (the eigenvalues of the linearized 
Poincare map) do not depend on the choice of Poincare 
section (cf. Section 1.5 in [13]). The following lemma 
generalizes this result to the hybrid setting by demonstrating 
that if a Poincare map obtained from one domain has an 
attracting invariant submanifold via Lemma [3] then the map 
obtained in any other starting domain has a diffeomorphic 
attracting submanifold. As a consequence, non-zero Floquet 
multipliers are shared between the Pj's after a sufficient 
number of iterations. 

Lemma 4. Let j g {1,...,A;} and n > min^dimP^. If 
Pp has constant rank equal to r near jj, then P™ +1 has 
constant rank equal to r near 7^ for all I G {1, . . . , k}. 

3 We regard subscripts modulo k so that = Dq. 
4 Otherwise we can find {-Bj} J=1 be such that Bj C Dj is open, 7 C 
U?=i Bj, and B 4 n Bj = if i ^ j, then proceed on D := ]J^ =1 Bj. 




Fig. 2. Illustration of a hybrid domain containing part of a periodic 
orbit. The periodic orbit 7 enters the domain Dj inside the submanifold 
Tj C dDj via the reset map Rj-i- Initial conditions in Tj flow to the 
submanifold Sj C dDj via the vector field Fj. The map tpj smoothly 
reparameterizes these trajectories by the time required to pass from Tj to 
Sj, thus i/jj (cr, Tj) is an embedded submanifold for all a £ [0, 1] and Sj = 
tpj(l,Tj). While in domain Dj, 7 lies in the invariant submanifold Mj 
constructed in TheoremfTl By construction, Mj is an integral submanifold of 
Fj and dim Mj < dirrTDj; see Fig.[T|for an illustration when dimMj < 
dimD,. 



In the proof of Lemma [4] we make use of an elementary 
fact from linear algebra. The result is easily obtained from 
Sylvester's inequality (cf. Appendix A. 5.4 in [34]). 

Proposition 2. For j G {1, . . . , k}, suppose Aj e R n i+ lXn i 

where = ri\, define Bj := Aj-\ ■ ■ ■ A±A k ■ ■ ■ Aj, and 
let n > raiiijnj. Then for all £ G {1, ...,&}, we have 
rankB" +1 = rankB^ 1 = rankB] 1 . 

Proof, (of Lemma |5J By Lemma [3] there is a neighborhood 
Nj C Tj of jj on which P." has constant rank equal to r. 
Fix I G {1, . . . , /c}, let := Pj-i ° ■ ■ • o p t , and define 
N e ■= {piy 1 ^). Then c T t is a neighborhood of 7^ 
and, for all x € iVg, by Sylvester's inequality 

rank(F; l+1 ) st (x) < rank^")* (V^)) = r - 
Furthermore by Proposition [2] 

rank(P; l+1 M 7 ,) = rank(P; +1 ), ( 7i ) 

= rank(P j r')*(7 i ) = r. 

We conclude the rank of P" +1 is at least r on a neighborhood 
Lt C 2> of 7^, whence rankP" +1 = r on L< fl iV^. □ 

As a consequence, if the Poincare map associated with 
any section for the periodic orbit 7 satisfies the hypotheses 
of Lemma [3] then the Poincare map associated with any 
other section also satisfies the hypotheses. 

Remark 7. It may be easier to evaluate the rank of the 
Poincare map in some domains than others. In particular, 
if Pj is a diffeomorphism for some j G {1, . . . , k}, then all 
iterates are constant rank. 

C. Hybrid Invariant Subsystem 

This section contains the main result of this paper: when 
iterates of the Poincare map associated with a periodic orbit 
of a hybrid dynamical system have constant rank, trajectories 
starting near the orbit converge in finite time to an embedded 
smooth dynamical system. 



Theorem 1. Let H = (D,F,R) be a hybrid dynamical 
system, 7 a periodic orbit of H, and suppose the composition 
of any Poincare map for 7 with itself at least miix, dim Dj 
times has constant rank equal to r on a neighborhood of its 
fixed point. Then there is an (r + 1)- dimensional dynamical 
system (M, G), a hybrid dynamical embedding f : M — > D, 
and an open hybrid set W C D so that 7 C f(M) (1 W and 
trajectories starting in W flow into M in finite time. 

Proof. By assumption, we may apply Lemma [5] to P to 
obtain a neighborhood N C T\ of 7 n T\, an embedded 
submanifold S C Ti containing 7 fl T\, and a pair of 
neighborhoods U, V C £ of jHTi so that P\ v : U -> V is a 
diffeomorphism and dim U = r. Now we consider the subset 
of D obtained by propagating each x € U around one cycle. 
Let Ui = U and Uj = Pj_i{Uj_i) for j = 2, . . . , k. Away 
from the boundaries, we can obtain the desired set directly 
from as Int(M,) := ^ ((0, 1), Uj). For j = 2, . . . , k - 1 
we can simply attach the corresponding boundaries to obtain 
Mj := tpj([0,l],Uj). However, since we may not assume 
U C V or V C U (only that U n V is a neighborhood of 
7flTi), we must be careful in attaching the boundary between 
M k and Mi. Thus, we let Ml = Vi((0, 1], U x ) U (JJ X n 
P k {U k )) and Af fc =M[0A),U k )U{M^U k )nR- 1 (U 1 )). 
With this construction, for each j — 1, . . . , k we have that 
Mj is a smooth submanifold with boundary dMj C Tj U Sj 
and dMj contains both points in jj OdDj; see Fig. [2] for an 
illustration of Mj, 

Since Mj is an integral submanifold of F on Dj, the 
vector field F restricts to Mj . Letting Gj denote this restric- 
tion, each (Mj,Gj) is a smooth dynamical system and Gj 
points inward on dMj D Tj and outward on dMj Sj . Since 
P\u is a diffeomorphism, each Rj\dM-nS' '■ dMj n Sj — > 
dMj + i n T J+ i is a diffeomorphism as well. Therefore we 
may glue these systems together one-by-one via Lemma [2] to 
obtain a smooth dynamical system without boundary (M, G) 
which embeds into H and contains 7. 

Finally, let AT, {/, and V be as above and let 8 > 
be an arbitrary positive number. Note that by continuity 
of P and the time-to-impact maps of Lemma [T] there is 
a neighborhood W x C N C T a of 7 n T x so that P n (W x ) C 
£7 PI V and each w £ W% flows into U V before time 
11T + S. Since the Pj's are continuous, for j = 2, . . . , k there 
are neighborhoods Wj C T_,- of 7 n so that every w € Wj 
flows into Wj+i before time + Taking the union 
of these neis hborhoods as W = ^([0, 1], Wj) yields 
an open hybrid submanifold W C D so that 7 C M fl W 
and every point in W flows into Wi before time r + S, and 
hence into M before time (n + 1)t + 2<5; see Fig. [T] for 
an illustration of these neighborhoods in a particular two- 
domain hybrid dynamical system. □ 

Corollary 1. 7 is asymptotically stable for H = (D,F,R) 
if and only if 7 is asymptotically stable for (M, G). 

Proof. Since all trajectories in a neighborhood W of 7 reach 
M in finite time and the hybrid flow is continuous near 7, 
trajectories in W will converge to 7 asymptotically if and 



only if trajectories in W D M converge to 7 asymptotically. 
This occurs precisely when 7 is asymptotically stable for 
(M, G) since by construction M is an integral submanifold 
of F and R\mc\S :MflS-)-MnTisa diffeomorphism. 

□ 

If each of the Dj 's have the same dimension and R : S — > 
T is a diffeomorphism, the rank condition of Theorem [T] 
is trivially satisfied, and we can globalize the construction 
using Lemma [2] This provides a smooth n-dimensional 
generalization of the construction in [35]. 



Corollary 2. Let H = (D, F, R) be a hybrid dynamical 
system with D = U je 7 Dj, R : S — > T, and dD = S U T. 
If dim Dj = n for all j € J and R is a diffeomorphism, 
then there is a surjective hybrid dynamical embedding from 
an n-dimensional dynamical system [M, G) onto H. 

IV. Examples 

A. Hybrid Floquet Coordinates 

The following single-domain system clearly satisfies the 
hypotheses of Theorem [T] and demonstrates the canonical 
form for hybrid Floquet coordinates. 

Example 1. Let H = (D,F,R) be a hybrid system over 



the single domain D = [0, 1] x Hl k y 

F(t,x,z) = & + E"=i/ i («^)^7 



1 with vector field 



reset map R : {1} x R k x R e ->• {0} x R k x R e defined 
by R(l,x,z) — (0,x,Az) where A £ R ixe is nilpotent, 
f(t, = 0/or all t £ [0, 1] and some £ G R k , and g l (t, 0) 
for all i. Consider the Poincare map 

P:{0}xI k xR'4 {0} x R k x R e . 

It is clear that P(0, £, 0) = (0, £, 0), 

P e ({0} x R k x R e ) = {0} x R k x {0} , 

ranki?| {1}xRfcx{0} = k. 

Therefore rm\kP k+l = fc, whence we may apply Theorem^ 
The resulting smooth invariant subsystem is diffeomorphic to 
S 1 x R k . 

B. Vertical Hopper 

We apply Theorem [T] to demonstrate the existence of 
low-dimensional invariant dynamics in the model for forced 



vertical hopping illustrated in Fig. 3a The state space in 
the aerial phase is D a := S 1 x TR> x TR. Writing 



f>, x, x, y, y) € D a , the aerial dynamics are given in Fig. 3b 



When the lower mass rests on the ground, the state space 



resides in D„ 



:= S 1 



TR and the dynamics of the 



upper mass are obtained by restricting to the submanifold 
{((j),x,x,y,y) : x = x = 0} as in Fig. 3b Transition from 
the aerial to the ground domain occurs when the lower mass 
collides with the ground, and the state is reset according to 
(4>, 0, x, y, y) H> (4>, y, y). The lower mass lifts off when the 
normal force required to keep it from penetrating the ground 
plane becomes zero, i.e. when mg — —k£o — asin0 + ky, 
and the state is reset via ((f), y, y) \-> (</>, 0, 0, y, y). 



For 



,x,x,y,y) G D a : 




(a) vertical hopper schematic 



= ul, 
mi = — k£o — a sin 

+ k(y — x) — bx — gm, 
My = k£o + a sin 

- k(y - x) - gM. 

For (,</>,y,y) 6 -D g : 

= LO, 

My = k£o + a sin 
- ky - gM. 
(b) hopper dynamics 

Fig. 3. Schematic and dynamics of vertical hopper, (a) Two masses m and 
M, constrained to move vertically above a ground plane in a gravitational 
field with strength g, are connected by a linear spring with stiffness k and 
nominal length £o- The spring is equipped with an actuator that exerts a 
phase-varying force asin0 where = u. The lower mass experiences 
viscous drag proportional to velocity with constant b when it is in the air, 
and impacts plastically with the ground (i.e. it is not permitted to penetrate 
the ground and its velocity is instantaneously set to zero whenever a collision 
occurs), (b) Hopper dynamics in aerial and ground domains. 



Numerical simulation^] indicate that with parameters 
(m,M,k,b,£ ,a,u, g) = (1, 2, 10, 5, 2, 20, 2tt, 2), the hy- 
brid system possesses a stable periodic orbit, 7. Choosing 
a Poincare section in domain D g at <fi = 0, we find that 
7 intersects this section at the point (y, y) ~ (1.96,1.88) 
and that the eigenvalues of the linearized Poincare map are 
—0.25 ± 0.70j. Both eigenvalues lie inside the unit disc, 
corroborating the observed stability of the orbit. Further, 
since neither eigenvalue is close to zero, we conclude the 
Poincare map has full rank equal to 2 near its fixed point. 
Therefore by Remark [7] the hypotheses of Theorem [T] are 
satisfied, and we conclude the system's dynamics collapse 
to a smooth 3-dimensional subsystem after one hop. 



V. Discussion 

We demonstrated the existence of a locally attracting 
constant-dimensional invariant subsystem near a hybrid peri- 
odic orbit whenever iterates of the associated Poincare map 
have constant rank. Under a genericity condition, near a 
periodic orbit of a smooth dynamical system there exist 
Floquet coordinates in which the dynamics decouple into 
a constant-frequency phase variable and a time-invariant 
transverse linear system [11], [12], [13]. Under the additional 
rank hypothesis of Theorem [T] we obtain a canonical form 
for the Floquet structure of a hybrid periodic orbit. Indeed, 
the smooth subsystem (M , G) foliates the dynamics near 
the periodic orbit in each domain. Thus the behavior of 
the hybrid system near the orbit is a trivial extension of 

5 Note that simulation of hybrid dynamical systems is non-trivial. We 
make use of a recently-developed algorithm with desirable convergence 
properties [36]. In particular, we use Euler step size h = 1 X 10 -3 and 
relaxation parameter e = lx 10~ 12 . As a note to practitioners, we found 
that numerical linearization of the Poincare map via finite differenes was 
sensitive to the coordinate displacement when using large values for the 
relaxation parameter. The sourcecode for this simulation is available online 
atlhttp : //purl . org/sburden/cdc2011| 



the behavior of a smooth system — portions of the smooth 
dynamics are "stacked" in transverse coordinates and anni- 
hilated within a finite number of cycles via a nilpotent linear 
operator. On the smooth subsystem, the standard construction 
of Floquet coordinates may be applied, generalizing the 
class of systems which may be analyzed using the empirical 
approach developed in [14], [15]. 

In addition to providing a canonical form for the dynamics 
near such non-degenerate periodic orbits, the results of 
this paper suggest a mechanism by which a many-legged 
locomotor may formally collapse a large number of degrees- 
of-freedom to produce a low-dimensional coordinated gait. 
This provides a link between currently disparate lines of 
research, namely the formal analysis of hybrid periodic 
orbits, the design of robots for locomotion and manipulation 
tasks, and the scientific probing of neuromechanical control 
architectures in organisms. It shows that hybrid models 
naturally exhibit dimension reduction, that this reduction may 
be deliberately designed into an engineered system, and that 
evolution may have exploited this reduction in developing its 
spectacular locomotors. 
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